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(54) Image processing apparatus and Image processing method 



(57) An image processing apparatus and an image 
processing method are proposed for the high speed 
generation of a model, such as a plane picture in anima- 
tion, for which an outline is drawn. In the image process- 
ing apparatus, for using computer graphics to generate 
a polygon model in three-dimensional coordinate 
space, a first model, for which the normal vectors of pol- 
ygons are directed outward, and a second model, in 
which the first model is included and for which the nor- 
mal vectors of polygons are directed inward, are synthe- 
sized as a single model. The direction of the normal 



vector of a polygon is employed in the hidden surface 
removal process to determine whether the polygon 
should be displayed. That is, when the normal vector of 
a polygon includes an element extended in the direction 
of the viewpoint, the pertinent polygon is displayed; but 
when the normal vector of a polygon does not include 
an element extended in the direction opposite to that of 
the viewpoint, the pertinent polygon is not displayed. As 
a result, the second model is expressed as an outline of 
the first model. 
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Description the line width of the outline. 



BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to an image 
processing apparatus and to an image processing 
method for computer graphics. 

Related Arts 

[0002] In image processing using computer graph- 
ics, normally, a polygon model is generated in three- 
dimensional coordinate space, and hidden surface 
removal and shading processes are performed for the 
polygon model. The obtained model is converted into a 
model with two-dimensional coordinates, which is then 
superimposed on a background screen. In this case, in 
order to highlight the model on the background screen, 
a special calculation is performed for the model data to 
simplify the gray scaling of the model or to add an out- 
line to the model. 

[0003] For example, for software used for preparing 
a 3D-CG image, a polygon model in three-dimensional 
coordinate space is projected onto a two-dimensional 
screen, the boundary between the projected model and 
the background screen is calculated, and a tine having 
a designated width is drawn along the boundary to gen- 
erate the outline. 

[0004] As is described above, in conventional three- 
dimensional computer graphics, the process of generat- 
ing the outline for a model is performed by extracting 
portions of three-dimensional polygon models for which 
an outline should be generated, and by drawing a line 
having a designated width at the extracted portions. 
Thus, the load is increased which is placed on the cal- 
culations performed to identify the portions of the poly- 
gon models where the outline is to be generated, and an 
extended time is required for the process of generating 
the outline. 

[0005] However, in a game machine, for example, 
which employs computer graphics, models must be 
changed in real time in accordance with instructions 
entered by a player. And since according to the conven- 
tional outline generation method an outline is generated 
by calculating the boundary between changing models, 
an extended time is needed for the required calcula- 
tions. Thus, in a game machine for which it is important 
that a model respond immediately to manipulation by a 
player, the process of generating an outline for a model 
can not be performed in real time. 
[0006] In addition, since according to the conven- 
tional method the outline is generated by drawing a line 
having a designated width along the boundary between 
a model and a background screen, regardless of the 
distance between the model and a camera, a perspec- 
tive view of the model can not be obtained by changing 



SUMMARY OF THE INVENTION 

s [0007] H is. therefore, one objective of the present 
invention to provide an image processing apparatus and 
an image processing method for the high speed gener- 
ation of a model, such as a plane picture in animation, 
for which an outline is drawn. 

10 [0008] It is another objective of the present inven- 
tion to provide an image processing apparatus and an 
image processing method for the high speed changing 
of the line width of the outline of a model. 
[0009] To achieve the above objectives, provided is 

is an image processing apparatus, for using computer 
graphics to generate a polygon model in three-dimen- 
sional coordinate space wherein a first model, for which 
the normal vectors of polygons are directed outward, 
and a second model, in which the first model is included 

20 and for which the normal vectors of polygons are 
directed inward, are synthesized as a single model, and 
an image processing method therefor. 
[001 0] According to the present invention, the direc- 
tion of the normal vector of a polygon is employed in the 

25 hidden surface removal process to determine whether 
the polygon should be displayed. That is, when the nor- 
mal vector of a polygon includes an element extended in 
the direction of the viewpoint, the pertinent polygon is 
displayed; but when the normal vector of a polygon 

30 does not include an element extended in the direction 
opposite to that of the viewpoint, the pertinent polygon 
is not displayed. As a result, the second model is 
expressed as an outline of the first model. 
[001 1 ] Furthermore, according to the present inven- 
ts tion, since an outline is generated by processing a 
three-dimensional polygon, and the calculations for 
detecting the boundary between the model projected on 
in a two-dimensional screen and a background screen 
are not required, the outline can be generated at an 

40 extremely high speed. 

[0012] In addition, since an outline is added to a 
three-dimensional polygon, the portion of an outline 
which is near a camera is expressed as a thick line and 
the portion of an outline which is distant from a camera 

45 is expressed as a thin line, without any special calcula- 
tions being required. As a result, a perspective view of 
the model can be obtained without the processing 
speed being deteriorated. 



so BRIEF DESCRIPTION OF THE DRAWINGS 
[0013] 

Fig. 1 is a block diagram illustrating an image 
55 processing apparatus according to one embodi- 
ment of the present invention; 
Fig. 2 is a flowchart showing the image processing 
performed for the embodiment of the present inven- 
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tion; 

Fig. 3 is a diagram showing the wire frame for 
model A according to the embodiment of the 
present invention; 

Fig. 4 is a diagram showing data for model A s 
according to the embodiment of the present inven- 
tion; 

Fig. 5 is a diagram used for explaining polygon Pk 
of model A according to the embodiment of the 
present invention; 

Fig. 6 is a diagram showing data for model B 
according to the embodiment of the present inven- 
tion; 

Fig. 7 is a diagram showing a wire frame wherein 
model B is superimposed on model A in the embod- 
iment of the present invention. 
Figs. 8A and 8B are diagrams (I) for explaining the 
generation of an outline according to the embodi- 
ment of the present invention; 
Figs. 9A and 9B are diagrams (II) for explaining the 
generation of an outline according to the embodi- 
ment of the present invention; 
Fig. 10 is a diagram showing an example display 
wherein the normal direction for model B is inverted 
and models A and model B are positioned so that 
Lambart's law applies; 

Fig. 11 is a diagram showing an example display 
where model B is set to a constant state; 
Fig. 12 is a diagram showing an example display 
where model A is also set to a constant state; 
Figs. 13A and 13B are diagrams showing example 
displays according to the embodiment of the 
present invention; 

Fig. 14 is a diagram showing an example display for 
perspective according to the embodiment of the 
present invention; and 

Fig. 15 is a diagram showing a modification of the 
outline according to the embodiment of the present 
invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

[0014] The preferred embodiment of the present 
invention will now be described white referring to the 
accompanying drawings. Fig. 1 is a block diagram illus- 
trating an image processing apparatus according to the 
embodiment of the present invention. For fast image 
processing, the image processing apparatus in this 
embodiment includes a plurality of processors for the 
high speed, simultaneous performance of a geometry 
process and a rendering process. 
[0015] A CPU 1 reads an activation program from a 
boot ROM 5 and a system program from a system 
memory 3, and initializes the image processing appara- 
tus. The CPU 1 also reads, from a CD-ROM 4, an appli- 
cation program which it executes while exercising 
control of the image processing apparatus. 



[0016] A geometry processor 2 is a processor for 
performing the high speed processing of three-dimen- 
sional coordinate data for a polygon. The geometry 
processor 2 receives polygon coordinate data from the 
CPU 1 , processes them in accordance with the move- 
ment or the rotation of a model, calculates the normal 
vector of the polygon, and performs clipping and the 
changing of the field of view. 

[0017] As will be described later, in the image 
processing apparatus in this embodiment, an outline 
process for a three-dimensional polygon model is per- 
formed before a rendering processor 7 performs the 
rendering of the model. As a result the outline can be 
generated at an extremely high speed. 
[001 8] The rendering processor 7 is a processor for 
performing the high speed rendering of a model, and for 
performing a hidden surface removal process and a 
shading process for polygon data received from the 
geometry processor 2. In the image processing appara- 
tus in this embodiment, the high speed setting of the 
luminance of the outline is effected by the designation of 
a luminance parameter by the rendering processor 7. 
[001 9] The data for each individual screen for the 
model processed by the rendering processor 7 is stored 
in a graphic memory 8, and is converted into a video 
signal by a video D/A converter 9. Thereafter, the video 
signal is displayed on a television monitor (not shown). 
[0020] An audio processor 10 reads music data 
from the CD-ROM 4, and also reads from an audio 
memory 1 1 data for sound effects which correspond to 
the manipulation of controls by a user. These audio data 
are converted into analog signals by an audio D/A con- 
verter 12, and the analog signals are output to a televi- 
sion monitor or to an audio device (not shown). 
[0021 ] A bus arbiter 6 determines which processor 
is to be granted the right of use of a bus. That is, since 
in the image processing apparatus in this embodiment a 
plurality of processors, including the CPU 1 and the ren- 
dering processor 7, share a single bus, the bus arbiter 6 
manages and arbitrates the right of use of the bus so 
that data transmitted by the CPU 1 do not conflict with 
data transmitted by the rendering processor 7. 
[0022] A modem 13 is a modulator/demodulator for 
exchanging data along a telephone line, and is con- 
nected to a modular jack (not shown). It should be noted 
that peripheral devices connected to the bus arbiter 6 in 
Fig. 1 include those which are detachable from image 
processing apparatus or the controller, such as a switch 
for the key operation of a controller (not shown), a 
backup memory, a display device and a pointing device. 
[0023] The image processing according to the 
embodiment will now be described while referring to the 
flowchart in Fig. 2 and the example displays and exam- 
ple data shown in Figs, 3 to 14. As shown in the exam- 
ple diagrams in Figs. 3 to 14, a model is generated by 
employing dividing procedures, and, to provide a dis- 
play to be used for explaining the individual procedures, 
is projected onto a two-dimensional screen. However, 
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three-dimensional coordinate data are employed for the 
actual individual procedures, and the process of project- 
ing the model onto the two-dimensional screen is per- 
formed by the geometry processor 2 after all the 
procedures have been completed. 
[0024] As is shown in the flowchart in Fig. 2, the 
image processing in the embodiment is begun when the 
CPU 1 reads from the CD-ROM 4 data for model A (a 
model of a character for a game, etc.) (SI), and trans- 
mits the data to the geometry processor 2. Assume that, 
as is shown in Fig. 3, model A is a spherical object with 
horns extending to the sides and is constituted by poly- 
gons P1 to Pn. Also assume that the data for model A 
which is from the CD-ROM 4 are coordinates for the ver- 
texes of the individual polygons, normal vectors, colors, 
and transparencies. The coordinates of the vertexes are 
local coordinate values for which the center of gravity of 
model A is the origin. 

[0025] Fig. 5 is a diagram showing a polygon Pk of 
model A. Polygon Pk is formed with vertexes Vk1 to 
Vk4, and normal vectors nk1 to nk4 whose initial points 
are the vertexes Vk1 to Vk4. Since the model A is sup- 
posed to be viewed from a point outside model A, the 
normal vectors of the vertexes are directed towards 
points outside model A. Normal vector nk of polygon Pk 
is calculated by, for example, averaging the normal vec- 
tors nk1 to nk4 for the vertexes. 
[0026] Then, the geometry processor 2 prepares 
three-dimensional model B, which is larger by one size 
than model A (S2). Fig. 6 is a diagram showing the data 
for model B which were obtained by magnifying model A 
at a constant ratio.. Since the coordinates of the ver- 
texes of the polygons of model A are local coordinate 
values for which the center of gravity of model A is the 
origin, the coordinates of the vertexes for model B are . 
times the vertex coordinates for model A. It should be 
noted that, as will be described later, a magnification 
ratio for one part of model A may be changed instead of 
magnifying all of model A at ratio .. For example, if the 
magnification ratio for the horns of model A is 
increased, the horns can be emphasized. 
[0027] Following this, model B is superimposed on 
model A (S3). That is, the geometry processor 2 
matches the center of gravity of model B with that of 
model A in the world coordinate system, without chang- 
ing the directions of models A and B. The state wherein 
model B has been superimposed on model A is shown 
in Fig. 7. 

[0028] In this case, the superimposition of model B 
on model A actually means that the data for model B are 
linked to the data for model A by the geometry proces- 
sor 2. That is, since the data for model B are coupled 
together with the data for model A with a predetermined 
relationship, model B interacts with model A when, for 
example, model A moves in the world coordinate space. 
[0029] In the example in Fig. 7, the center of gravity 
of model B is matched with that of model A. However, 
the center of gravity of model B need only have a prede- 



termined relationship with that of model A. When, the 
center of gravity of model B is positioned slightly higher 
than that of mode) A, the outline of the upper portion of 
model A is thickened, so that the upper portion of model 

5 A can be highlighted. 

[0030] Next, while employing model A and model B 
as polygon models (S4), the geometry processor 2 
reverses the directions of the normal vectors of the pol- 
ygons of model B. The direction of the normal vector of 

w a polygon is used in the hidden surface removal process 
by the rendering processor to determine whether the 
relevant polygon should be displayed. Specifically, the 
rendering processor 7 displays a polygon when the nor- 
mal vector of the relevant polygon includes an element 

15 extended in the viewpoint direction, and does not dis- 
play the polygon when the normal vector includes an 
element extended in a direction opposite to that of the 
viewpoint. Therefore, model B is used as the outline for 
model A. 

20 [0031] This process will now be described, while 
referring to Figs. 8 and 9, by simplifying model A and 
model B. In Fig. 8A. spherical model A. in which the nor- 
mal vectors of polygons are directed outward, is 
included within spherical model B, which is larger than 

25 model A by one size and in which the normal vectors of 
polygons are directed inward. 

[0032] Fig. 8B is a diagram showing a polygon 
which is to be displayed when model A and model B are 
viewed from a viewpoint 15 outside model B. Since the 

30 normal vectors of model A are directed outward, each of 
the polygons for which the normal vectors include an 
element extended in the direction of the viewpoint, i.e., 
a semi -spherical portion 16 near the viewpoint 15, is to 
be displayed, and each of the polygons for which the 

35 normal vectors include an element extended in the 
direction opposite of that to the viewpoint, i.e., a semi- 
spherical portion 17 located at a distance from the view- 
point 15, is not to be displayed. 

[0033] Since the normal vectors of model B are 

40 directed inward, each of the polygons for which the nor- 
mal vectors include an element extended in the direc- 
tion of the viewpoint, i.e., a semi-spherical portion 18 
located at a distance from the viewpoint 15, is to be dis- 
played, and each of the polygons for which the normal 

45 vectors include an element extended in a direction 
opposite of that to the viewpoint, i.e., a semi-spherical 
portion 1 9 near the viewpoint 1 5, is not to be displayed. 
[0034] Fig. 9A is a diagram showing polygons 
which are to be displayed when model A and model B 

50 are viewed from the viewpoint 15 outside model B. For 
model A, the semi-spherical portion 16, for which the 
normal vectors include an element extended in the 
direction of the viewpoint and which is near the view- 
point 15, is displayed. For model B, semi-spherical por- 

55 tions 20 and 21, which are obtained by removing from 
the semi-spherical portion 18, located at a distance 
from the viewpoint 15, a portion hidden by model A rel- 
ative to the viewpoint 15, are displayed. 
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[0035] Fig. 9B is a diagram shewing an example 
two-dimensional screen coordinate display when model 
A and model B are viewed from the viewpoint 15. As is 
shown in Fig. 9B, for model A, polygons near the view- 
point 1 5 are displayed in the same manner as for a nor- 
mal display. For model B, only the portion outside model 
A is displayed, so that model B is displayed as the out- 
line for model A. 

[0036] Fig. 10 is a diagram showing an example 
display when the above process is performed for model 
A and model B in Fig. 7. The rendering processor 7 per- 
forms a process to add shading, due to a light source, to 
a model processed by the removal of hidden surfaces. 
The display example in Fig. 10 shows the state where, 
as a result of the shading process, both model A and 
model B are affected by a light source (Lambert state). 
[0037] As was previously described, since for 
model A the normal vectors of the polygons are directed 
outward, the polygons of model A on the viewpoint side 
are displayed in the same manner as for a normal dis- 
play, and polygons on the side opposite to that nearest 
the viewpoint are regarded as hidden surfaces and are 
not displayed. For model B, since the normal vectors of 
polygons are directed inward, the manner in which the 
polygons of model B on the side opposite to that nearest 
the viewpoint are displayed is the reverse of the manner 
employed for the normal display, and polygons on the 
viewpoint side are regarded as hidden surfaces and are 
not displayed. Polygons of model B which are on the 
side opposite to that nearest the viewpoint and which 
are hidden by model A are not displayed following the 
normal removal of hidden surfaces. As a result, model B 
is expressed so as to be near the outline of model A. 
[0038] Since in Fig. 10 the shading is performed by 
assuming that on the screen the light source is located 
above, the luminance at the top face of model A which 
is directed toward the light source is high, and the lumi- 
nance at the lower face, away from the light source is 
low. Since the normal vectors of polygons of model B 
are directed inward, model B is like a "bowl" covering 
model A, so that the luminance at the upper portion of 
model B is low, with no light from the light source, and 
the lower portion is illuminated slightly by receiving light 
from the light source. 

[0039] Then, model B is placed in the state where it 
is not affected by the light source (constant) (S5). This 
display is shown in Fig. 1 1 . As is shown in Fig. 1 1 , since 
model B is unaffected by the light source, all the por- 
tions have the same luminance, regardless of the posi- 
tions of the light source and the camera, and are 
displayed as an outline of model A. It should be noted 
that a constant luminance which is not affected by the 
light source is satisfactory for model B and that, while 
model B is displayed as a solid color, such as black or 
blue, depth can be displayed by slightly changing the 
color. 

[0040] Sequentially, model A is placed in the state 
where it is not affected by the light source (constant) 



(S6). This display is shown in Fig. 12. Since model A is 
unaffected by the light source and appears as a solid 
color having a constant luminance, a model produced 
by the synthesization of model A and model B is used 

s for a special presentation such as a sketch or for anima- 
tion, which differs from other computer graphics models. 
[0041] Next, the rendering processor 7 superim- 
poses the model produced by the synthesization of 
models A and B on the background screen {ST). Fig. 

io 13A is a diagram showing an example display where a 
model to which the outline has been added is superim- 
posed on the background screen through the image 
processing performed in this embodiment; and Fig. 13B 
is a diagram showing as a comparison an example dis- 

is play where a model without an outline is superimposed 
on the background screen. As is shown in Fig. 13 A, the 
outline functions to highlight the model and to separate 
it from the background, and especially in a game 
machine which uses computer graphics, when a two- 

20 dimensionally expressed character model is placed in a 
three-dimensional expressed background, the model 
can be vividly highlighted. 

[0042] Special effects for the image processing in 
this embodiment will now be described. Fig. 1 4 is a dia- 

25 gram showing an example display where the perspec- 
tive for model A and model B is emphasized while 
neither model is affected by the light source. Specifi- 
cally, since in three-dimensional coordinate space, in 
comparison with model A, model B is magnified at a 

30 constant ratio, the geometry processor 2 performs a 
normal transparency conversion, and as a result, the 
outline near the camera is thick and the outline at a dis- 
tance from the camera is thin. 

[0043] Therefore, since in the image processing of 
35 this embodiment the outline near the camera is thick 
and the outline at a distance from the camera is thin 
without special calculation being required, the perspec- 
tive of the model can be emphasized without reducing 
the speed. 

40 [0044] Rg. 15 is a diagram showing an example 
where one part of model B is modified in the image 
processing in this embodiment. That is, in the process 
at step S2 in Rg. 2 for preparing model B, which is one 
size larger than model A, the magnification ratio for a 

45 portion enclosed by a circle 31 in Fig. 15 is greater than 
is that for the other portions. The outline of a desired 
portion of model A can be thickened by increasing the 
magnification ratio for one part of model A, and an 
emphasized view of model A can be prepared from the 

so normal model. 

[0045] As is described above, according to the 
present invention, an image processing apparatus and 
an image processing method can be provided for the 
rapid generation of a model, such as a plane picture in 

55 animated wherein an outline is drawn, and for rapidly 
changing the line width of the outline of the model. 



5 



9 



EP 1 033 682 A2 



10 



Claims 

1 . An image processing apparatus, for using computer 
graphics to generate a polygon model in a three- 
dimensional coordinate space, comprising: 

geometry means for employing data for a first 
model read from a storage medium to generate 
a second model by the magnification of said 
first model at a predetermined ratio, for revers- 
ing the directions of the normal vectors of poly- 
gons of said second model, and for enclosing 
said first model in said second model; and 
rendering means for performing rendering for 
said first and said second models processed by 
said geometry means. 

2. An image processing apparatus according to claim 
1, wherein said geometry means links the center of 
gravity or vertex data for said first model with that 
for said second model in accordance with a prede- 
termined relationship. 

3. An image processing apparatus according to claim 
1 , wherein said geometry means changes said ratio 
for magnification of said first model in accordance 
with the portion of said first model. 

4. An image processing apparatus according to claim 
1 , wherein said geometry means links data for said 
second model with data for said first model. 

5. An image processing apparatus according to claim 
1, wherein said rendering means stabilizes the 
luminance of said second model. 

6. An image processing apparatus according to claim 
1 , wherein said rendering means sets a single color 
for said second model. 

7. An image processing apparatus according to claim 
5 or 6, wherein said rendering means stabilizes the 
luminance of said first model. 

8. An image processing apparatus for the display on a 
display device of a picture, obtained by a virtual 
camera, of a selected surface of a three-dimen- 
sional model located in a virtual three-dimensional 
space, wherein said three-dimensional model is 
formed by enclosing a first model in a second 
model obtained by magnifying said first model at a 
predetermined ratio; and wherein the surface of 
said first model facing said second model and the 
surface of said second model facing said first model 
are selected. 

9. An image processing apparatus according to claim 
8, wherein said first model and said second model 



are so located that the center of gravity or the vertex 
coordinate data for said first model is linked with 
that for said second model in accordance with a 
predetermined relationship. 

5 

1 0. An image processing apparatus for displaying a pic- 
ture, which is obtained by a virtual camera posi- 
tioned opposite a selected surface of a three- 
dimensional model located in virtual three-dimen- 

w sional space, wherein said three-dimensional 
model includes a line along an external circumfer- 
ence, and the thickness of said line is changed in 
accordance with the distance from said virtual cam- 
era 

75 

11. An image processing method, for using computer 
graphics to generate a polygon model in a three- 
dimensional coordinate space, comprising: 

20 a geometry step of employing data for a first 

model read from a storage medium to generate 
a second model by the magnification of said 
first model at a predetermined ratio, of revers- 
ing the directions of the normal vectors of poly- 
25 gons of said second model, and of enclosing 

said first model in said second model; and 
a rendering step of performing rendering for 
said first and said second models processed at 
said geometry step. 

30 

12. An image processing method according to claim 
11, wherein at said geometry step, the center of 
gravity or vertex data for said first model is linked 
with that for said second model in accordance with 

35 a predetermined relationship. 

13. An image processing method according to claim 
11. wherein at said geometry step, said ratio for 
magnification of said first model is changed in 

40 accordance with the portion of said first model. 

14. An image processing method according to claim 
11, wherein at said geometry step, data for said 
second model are linked with data for said first 

45 model. 

15. An image processing method according to claim 
1 1 , wherein at said rendering step, the luminance of 
said second model is stabilized. 

so 

16. An image processing method according to claim 
1 1 , wherein at said rendering step, a single color is 
set for said second model. 

55 1 7. An image processing method according to claim 1 5 
or 16, wherein at said rendering step, the lumi- 
nance of said first model is stabilized. 
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18. A storage medium storing an image processing 
program for using computer graphics to generate a 
polygon model in a three-dimensional coordinate 
space and data for a first model, said image 
processing program comprising: 5 

a geometry process step of employing said 
data for said first model read from a storage 
medium to generate a second model by the 
magnification of said first model at a predeter- io 
mined ratio, of reversing the directions of the 
normal vectors of polygons of said second 
model, and of enclosing said first model in said 
second model; and 

a rendering process step of performing render- is 
ing for said first and said second models proc- 
essed at said geometry process step. 

19. A storage medium storing an image processing 
program for controlling the display on a display 20 
device of a picture, obtained by a virtual camera, of 

a selected surface of a three-dimensional model in 
a virtual three dimensional space, and data for the 
three-dimensional model, 

wherein the data for the three-dimensional 25 
model is formed by enclosing a first model in a sec- 
ond model obtained by magnifying the first model at 
a predetermined ratio; and wherein the surface of 
the first model facing the second model and the sur- 
face of the second model facing the first model are 30 
selected. 
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